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Abstract 

While the importance of mHealth scale-up has been broadly emphasized in the mHealth community, it is necessary to guide 
scale up efforts and investment in ways to help achieve the mortality reduction targets set by global calls to action such as 
the Millennium Development Goals, not merely to expand programs. We used the Lives Saved Tool (L/ST)-an evidence- 
based modeling software-to identify priority areas for maternal and neonatal health services, by formulating six individual 
and combined interventions scenarios for two countries, Bangladesh and Uganda. Our findings show that skilled birth 
attendance and increased facility delivery as targets for mHealth strategies are likely to provide the biggest mortality impact 
relative to other intervention scenarios. Although further validation of this model is desirable, tools such as LiST can help us 
leverage the benefit of mHealth by articulating the most appropriate delivery points in the continuum of care to save lives. 
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Introduction 

Globally, nearly 3.5 million babies die each year in their first 
month of life, accounting for about 40-50% of under-five-child 
deaths. [1,2] These deaths are from largely preventable or 
treatable conditions such as birth asphyxia, prematurity and 
neonatal infections. [3] While Millennium Development Goals 
(MDGs) 4 has set country targets to reduce the under-five 
mortality rates (U5MR) by two thirds by 2015, governments are 
seeking to identify promising ways to improve the delivery of 
effective life-saving interventions, often within the context of 
limited financial and human resources. 

mHealth, the facilitation of improved healthcare services, health 
outcomes and provision of information via mobile and wireless 
technologies [4], has created a unique opportunity to transform 
the way in which global health challenges can be tackled. At the 
end of 2013, there were more than 6.8 billion mobile subscriptions 
worldwide, with 89% of them in developing countries. [5] Most 
people living on no more than USD 1 per day have access to these 
ubiquitous mobile phones, which have leapfrogged the pace of 
conventional landline infrastructure development. Numerous 
organizations have recognized the potential of harnessing mobile 
platforms [6] and have begun to explore ways to employ mHealth 
innovations to improve the delivery of maternal and neonatal 
health (MNH) interventions and practices. Sparse resources, vast 
populations and numerous socio-cultural barriers have challenged 



continued progress towards the MDGs in many settings, 
specifically MDGs 4 and 5, which are lagging behind. [7] Among 
the persistent health system challenges to improving these key 
maternal and newborn indicators are the lack of timely and 
actionable disease surveillance, a shortage of professional health 
workers, delays throughout the health delivery system, poor supply 
chain management and use of counterfeit drugs. [8] Driving the 
many experiments with mHealth is a belief that such strategies can 
help to overcome the health system challenges through improved 
access, transparency, and accountability while reducing costs and 
time. [9] mHealth initiatives also show promise in reaching 
underserved populations, particularly those in the developing 
world, changing health behaviors and outcomes, and addressing a 
wide variety of healthcare challenges. [10] The mobile platform 
presents the unique capability to strengthen the role of community 
health workers (CHWs) to deliver higher quality healthcare 
services wherever people are— not just in healthcare facilities [11]. 

mHealth for community health workers on maternal and 
newborn health services 

Capitalizing on the ability of mobile technologies to facilitate 
communication and remove barriers to healthcare, mHealth can 
support critical interactions between CHWs and families. [12,13] 
A review of recent mHealth approaches and examples of MNH 
interventions leveraging mobile technologies produced a number 
of illustrative examples. [14] [File SI] Projects have been selected 
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Table 1. Examples of mHealth programs on MNH services through CHWs. 



"The mobile phone intervention was 
associated with an increase in skilled 
delivery attendance: 60% of the 
women in the intervention group 
versus 47% in the control group 
delivered with skilled attendance. The 
intervention produced a significant 
increase in skilled delivery attendance 
amongst urban women (OR, 5.73; 95% 
CI, 1.51-21.81), but did not reach rural 
women." [34] 

"The perinatal mortality rate was 
lower in the intervention clusters, 19 
per 1000 births, than in the control 
clusters, 36 per 1000 births. The 
intervention was associated with a 
significant reduction in perinatal 
mortality with an OR of 0.50 (95% CI 
0.27-0.93}. Other secondary outcomes 
showed an insignificant reduction in 
stillbirth (OR 0.65, 95% CI 0.34-1.24) 
and an insignificant reduction in death 
within the first 42 days of life (OR 0.79, 
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Health in 
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and newborn health 
family meetings and 
labor and birth 
notification) 


(OR, 4.86; 95% CI, 2.67-8.86; P_.001)." 
[41] "Notification of health extension 
workers for labor and birth within 48 
hours was closely linked with receipt 
of postnatal care. Women with any 
antenatal care were 1.7 times more 
likely to have had a postnatal care visit 
(OR, 1.67; 95%; 95% CI 1.10-2.54; P 
_.001)." [41] 


E-IMCI 


Tanzania 


D-Tree 


(i) ANC/EPI/PNC (ii) Behavior 
changes through IEC 


(i) Point of care decision 
support through compliance 
to IMCI protocols 


"For all ten critical IMCI items included 
in both systems, adherence to the 
protocol was greater for elMCI than 
for pIMCI. The proportion assessed 
under pIMCI ranged from 61% to 98% 
compared to 92% to 100% under 
elMCI (p<0.05 for each of the ten 
assessment items)." [25] 



Project 
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Malawi 



UNICEF 



(i) HIV-antiretroviral 
therapy (ART) surveillance 
and treatment 



(i) Data 

collection and management 

(ii) SMS texting for health 
promotion and scheduled 
visits reminder 



" SMS delivery of results can increase 
turnaround times by 50% on average, 
with a greater positive impact in rural 
facilities" [42] 
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mHealth benefit/impact evidence 



M4RH 



PREVEN 



Kenya, 
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Peru 



USAID, FHI 360's 
PROGRESS 
(Program Research 
for Strengthening 
Services) 

Cell-Preven 



(i) Family planning 

(ii) Behavior changes 
through IEC 



(i) Sexual and 
reproductive health 
surveillance and 
service delivery 



(i) Data 

collection and management 

(ii) SMS texting for health 
promotion and scheduled 
visits reminder 

(i) Data 

collection and management 

(ii) SMS texting for 
health promotion and 
scheduled visits reminder 



Aceh Besar 
Midwives 



Indonesia 



UNICEF, UNFPA, 
and 

World Vision 



(i) Behavior changes 
through IEC 

(ii) ANC/EPI/PNC 

(iii) SBA/FD 



(i) Data collection 
and management 

(ii) SMS texting for health 
promotion and scheduled 
visits reminder 

(iii) Emergency medical referral 
(e.g. referral calling) 



User interviews reported various 
positive responses including "the text 
messaging service was perceived as 
being private, convenient, and cost- 
effective." [33] 

Lessons include "Two-way 
information systems are more than 
just collecting data. They provide 
feedback and support to health care 
workers in the field. Many times, only 
managers have information that 
allows them to monitor and evaluate 
data but these systems do not prove 
any aggregate value to health care 
workers in the field. A well-designed 
information system has to support 
and enhance the performance of all 
user levels in a secure environment." 
[30] "Prahalad (2005) has reported 
that health workers in some 
developing countries spend as much 
as 40% of their time filling out forms, 
compiling and copying data from 
different pro-grams (e.g., tuberculosis, 
malaria, HIV/AIDS, etc.). By choosing 
the most appropriate information 
technology, we can avoid duplication 
and deploy different devices-i.e., cell 
phones, Internet-to report from each 
public health program." [30] 

"Findings from the project indicate 
that the mobile phone has proven to 
be an effective and efficient device for 
facilitating smoother communication, 
and allowing speedier emergency 
response. The system also aids in 
gathering and disseminating health- 
related information to midwives, who 
in turn convey this knowledge to the 
patient community." [13] 
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mHealth benefit/impact evidence 
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SOURCE: Compiled from references [13,22,25,28-29,30-34,40-45]. 
doi:1 0.1 371 /journal.pone.01 02224.t001 



based on demonstrated lessons, benefit or impact evidence in 
coverage improvements; these illustrative examples of strategies 
used across the MNH continuum have been summarized in 
Table 1. 

Numerous mHealth strategies for CHWs leverage mobile phone 
connectivity and computing capacity to enable task shifting, 
bolster core skills, enhance outreach and facilitate referral, while 
improving data collection and transmission. [15] [16] Key 
examples of mHealth platforms, engaging CHWs delivering 
MNH interventions, involve data collection and management 
(e.g. risk assessment and classification, vital event tracking) [17] 
[18] [19], Short Message Service (SMS) texting for health 
promotion and scheduled visits reminder [20] [21] [22], emer- 
gency medical referral [23] and point of care support [24] [25], 
often through two simple functions, voice communication [26] and 
texting [27], and sometimes with customized applications, linked 
to more complex back-end, or server-side, messaging and 
information services. To help CHWs register and identify women 
and newborns in their area who need healthcare services, Mobile 
Technology for Community Health (MOTECH) [28] [29] and 
Cell-PREVEN [30] use electronic handheld devices for texting or 
data collection and management through mobile phones or 
personalized digital assistants (PDA), automating the process of 
tracking patients who have received care. During the maternal 
postpartum/neonatal postnatal period, Mobile Alliance for 
Maternal Action (MAMA) [27,31] [32] and Mobile for Repro- 
ductive Health (m4RH) [33] use voice communication and SMS 
texting to remind scheduled antenatal care (ANC) or postnatal 
care (PNC) visits and to promote behavior change and commu- 
nication messages (BCC) in the antenatal/ early pregnancy period. 
At birth, Wired Mother uses SMS reminder and mobile phone 
voucher component to promote facility delivery. [34] In this way, 
these programs help improve health-seeking and preventative 
behaviors of pregnant women, new mothers and their families, 
such as skilled birth attendance, immediate exclusive breast 
feeding, wrapping of the newborn, clean postnatal practices, and 
danger sign recognition. To improve child health and reduce 
childhood mortality and morbidity, Interactive Research and 
Development (IRD) [35] and mTikka [36] use text messaging 
systems with cash incentives to facilitate routine immunization 
programs, sending reminders to registered parents when their 
child is due for immunization and/ or to provide health promotion 



notifications for immunization campaign days. These mHealth 
applications, such as Electronic Integrated Management of 
Childhood Illness (elMCI), have also been utilized to guide point 
of care support in which CHWs adhere step by step to Integrated 
Management of Childhood Illness (IMCI) protocols, a standard- 
ized strategy developed by the World Health Organization 
(WHO) and UNICEF to reduce mortality and morbidity among 
children younger than 5 years of age [37] [38]. 

While there has been a growing body of evidence that has 
documented the benefit of mHealth as exploratory or observa- 
tional studies, few studies systematically demonstrated effectiveness 
of mHealth strategies to promote MNH service delivery. Free et al 
conducted a comprehensive systematic review and meta-analysis 
on the effectiveness of mobile health technologies to improve 
health care service delivery processes. The findings demonstrated 
that the pooled effect on appointment attendance using SMS 
reminders vs no reminder was increased, with a relative risk (RR) 
of 1.06 (95% confidence interval (CI), 1.05-1.07). [39] Wired 
Mothers, based on a clustered randomized controlled trial in 
Tanzania, recently demonstrated a positive effectiveness of 
mHealth in improving ANC attendance (odds ratio (OR), 2.39; 
95% CI, 1.03-5.55) [22], skilled birth attendance (SBA) utilization 
(OR, 5.73; 95% CI, 1.51-21.81) [34], and perinatal mortality 
reduction (OR, 0.50; 95% CI, 0.27-0.93). [40] Maternal and 
Newborn Health in Ethiopia Partnership (MaNHEP) stated, 
"Women who had additionally attended 2 or more community 
MNH meetings with family members and had access to a health 
extension worker's mobile phone number were 4.9 times more 
likely to have received postnatal care (OR, 4.86; 95% CI, 2.67— 
8.86)." and "Notification of health extension workers for labor and 
birth within 48 hours was closely linked with receipt of postnatal 
care. Women with any antenatal care were 1.7 times more likely to 
have had a postnatal care visit (OR, 1.67; 95% CI, 1.10— 
2. 54). "[41] Project Mwana, using mobile phones to improve early 
infant diagnosis of HIV and postnatal follow-up and care, reported 
that "SMS delivery of results can increase turnaround times by 
50% on average, with a greater positive impact in rural 
facilities." [42] The Better Border Health Program on the Thai- 
land-Myanmar border combined web-based and mobile technol- 
ogy to generate Antenatal Care/Expanded Program on Immuni- 
zation (ANC/EPI) visit schedule dates and update scheduling 
status, showing "ANC/EPI coverage in the study area along the 
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Figure 1. mHealth Health Service Coverage Increase Impact Model. SOURCE: Authors. 
doi:10.1371/journal.pone.0102224.g001 



country border improved; numbers of ANC and EPI visits on-time 
as per schedule significantly increased; there was less delay of 
antenatal visits and immunizations." [43] In Uganda, RapidSMS- 
Maternal and Child Health reported a 27% increase in facility 
based delivery from 72% to 92% at the end of the twelve months 
pilot phase. [44] Also, the Rural Extended Services and Care for 
Ultimate Emergency Relief (RESCUER) Project demonstrated 
that improved communication and transportation links between 
traditional birth attendants and health posts resulted in increased 
and more proximate referrals as well as the improved delivery of 
healthcare to a large number of pregnant women. A notable 
impact of the project was that, "the increased number of deliveries 
under trained personnel and increased referrals to health units led 
to a reduction of about 50 percent in the maternal mortality rate 
(MMR) in three years," [45] although this reduction was not 
exclusively attributed to the mHealth intervention. 

The mechanisms by which mHealth promotes service delivery 
can be explained through an impact logic model. Figure 1 
demonstrates how mHealth systems can contribute to increased 
uptake of health services, including ANC, Skilled Birth Atten- 
dance/Facility Delivery (SBA/FD), Breastfeeding (BF), and PNC. 
The simple yet powerful functions of mobile phones such as data 
registration/management and texting/calling could facilitate 
health service delivery in low resource settings by promoting both 
demand and supply. First, in terms of demand promotion, 
mHealth can send SMS reminder messages to mothers in order 
to enhance knowledge and promote timely and appropriate care- 
seeking and therefore enhance utilization of health services. 



Second, in terms of supply promotion, mHealth can promote 
supply management which can reduce the risk of stock-outs and 
facilitate referrals between CHWs and doctors. [46] mHealth also 
can enhance performance productivity or efficiency through real- 
time task monitoring or decision support tools. [38] When 
appropriate, mHealth could help task shifting through education 
and training, where limited numbers of skilled health workers are 
available [47]. 

Despite these promised results, many projects in developing 
countries have not established comprehensive quantitative evi- 
dence demonstrating the extent to which SMS reminders or calls 
contribute to improving coverage or changing mortality related to 
the MNH interventions. Mechael proposed that "the important 
next step is that key mHealth stakeholders consider focusing on 
catalyzing the testing and scale up of interventions that show 
promise in achieving key health outcomes as laid out by the 
Millennium Development Goals (MDGs) for health. "[48] In the 
absence of more comprehensive evidence, however, conclusions 
on priorities and mHealth potential remain merely presumptive. 

What is LiST? 

The Lives Saved Tool (LiST, www.livessavedtool.org) is a software 
that can be used to identify priority areas for maternal, child and 
neonatal health investment by allowing users to analyze multiple 
scenarios to estimate the potential health impact associated with 
improvements in coverage of interventions of known efficacy. [49- 
54] LiST, based in the Spectrum software, was initially developed 
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by the Child Health Epidemiology Reference Group (CHERG) 
for the WHO and UNICEF with technical content presendy 
managed by the Johns Hopkins Bloomberg School of Public 
Health's Institute for International Programs. It combines current 
mortality rates and health intervention coverage changes over time 
with evidence of effectiveness to model changes in numbers of 
maternal, neonatal, child (1-59 month) deaths and stillbirths as 
well as rates/ratios. Impact can be categorized by (a) year of 
implementation; (b) population sub-group (e.g. mothers, new- 
borns, children under 5 years); (c) cause of death and/or (d) 
intervention. [55-59] LiST marries data on the effectiveness of 
critical MNH interventions with estimates of service delivery 
coverage to estimate the impact of implementing a given service/ 
intervention as part of a larger package or as a stand-alone 
endeavor. Users can modify coverage rates based upon external 
assumptions about the intensity of support provided (including 
level and duration of financial support), status of the health 
infrastructure, quality of program implementation, and other 
relevant contextual factors. The impact of implementing MNH 
services as part of a larger continuum of care can then be modeled. 
[52] Ultimately, a measure of impact emerges in terms of deaths 
averted. [60] Many studies have demonstrated considerable 
validity of its modeled results. [50,52,53] More specific methods 
and assumptions behind the LiST modeling have been published 
[56,61]. 

Why LiST 

In a recent review of mHealth strategies, [1 1] we proposed that 
a reframing of mHealth should be encouraged, viewing mobile 
technologies as a mechanism to improve the coverage of 
interventions of known efficacy (e.g. Vaccines, Antenatal Care, 
Skilled Birth Attendance). This approach facilitates the measure- 
ment of the estimated impact of mHealth investments, focusing on 
coverage and process indicators, instead of distal survival 
outcomes. In this respect, we explore the use of LiST as a tool 
for planning and prioritizing strategic guidelines for mHealth- 
based strategies targeting interventions delivered by CHWs, aimed 
at reducing maternal, newborn and child mortalities. Three 
prominent features of LiST allow it to be a useful modeling tool for 
estimating the potential effect of mHealth. First, LiST uses coverage 
as an input parameter, determining the level of health service 
coverage increases from the present time toward a target year, to 
model the mortality impact of scaling up a specific maternal, 
newborn and child health intervention. As noted above, given the 
nature of mHealth facilitating health service provision of proven 
intervention, coverage-defined as a percent of a population in 
need who received a particular health intervention-is often 
regarded as an important health service outcome indicator in 
mHealth program evaluation, reflecting measures of access and 
quality of health provision. Second, LiST models the effects of 
changes in individual-level interventions such as exclusive breastfeeding 
of a newborn or Oral Rehydration Solution (ORS) treatment of a 
child with diarrhea. This is applicable to the characteristics and 
benefits of mHealth with its capacity in connecting and linking 
health services for individuals. Third, LiST modeling can be used 
as a tool to investigate not only single interventions, but also a set 
of specific interventions, which may be combined into packages. This 
approach can mimic mHealth programming, which often 
promotes an integrated approach across different health interven- 
tions through a common service delivery platform. For example, 
text messaging can be used to distribute various behavior change 
messages, reminders of services for ANC visits, breastfeeding 
promotion, and vaccination scheduling. More importantly, LiST 
systematically calculates the mortality impact of individual or 



combined interventions based on the evidence pool embedded into 
the system. This cross-cutting approach can not only improve the 
potential value of mHealth investments, but could create synergy 
and improve efficiency in implementing several interventions at 
the same time. Rather than creates new silos of health innovation, 
mHealth optimizes a standardized service delivery protocol to 
connect resources across health system programs. In this respect, 
this study explores the use of LiST to model mHealth strategies in 
two countries, Bangladesh and Uganda, estimating the neonatal 
mortality averted from different scenarios involving maternal and 
newborn health program interventions. 

Methods 

Bangladesh and Uganda were selected in particular due to their 
relatively high neonatal mortalities (27 and 26 per 1,000 live births 
respectively, as of 2010) and the fact that mHealth programs have 
been positively recognized by their governments and actively 
implemented on the ground. The baseline data sources, embedded 
in LiST, draw from multiple academic publications and statistics 
from Demographic and Health Surveys (DHS), Multiple Indicator 
Cluster Survey (MICS), UNICEF, and the World Bank. Among 
the inputs in LiST, four key interventions-Antenatal care (ANC), 
Skilled birth attendance and/or Facility delivery (SBA/FD), 
Breastfeeding promotion (BF), and Postnatal care (PNC) -were 
identified as representative core health services across the 
continuum of care for MNH. Specific definitions and the 
components of the interventions applied in the LiST are explained 
in Table 2 and File S2. Using 2015 as the target year, scenarios 
were created examining various coverage increase targets and the 
impacts of bundling packages of interventions. 

Three analyses were conducted for each of the countries to 
determine the estimated impact of different intervention packages 
on neonatal mortality. The first analysis modeled improving 
coverage of four key MNH interventions, ANC, SBA/FD, BF and 
PNC to three different target coverage levels-10%, 30%, and 
50%. The target coverage in 2015 was defined in a relative manner 
by multiplying the baseline coverage of each intervention in 20 1 1 
by 1 10%, 130% and 150%. We do not have enough evidence to 
set particular absolute target coverage numbers for any interven- 
tion. These hypothetical coverage increase scenarios can be 
considered as a fairly feasible and conservative approach, given the 
practices and evidence, as discussed above. We assumed a linear 
growth in coverage, from the baseline year 201 1 to the target year 
2015. The mortality impact outcomes were compared across 
different coverage increase scenarios, and health interventions 
scenarios. (Table 2). 

The second analysis focused on bundled packages of interven- 
tions based on common mHealth strategies, as mHealth strategies 
can facilitate integrated interventions through a common com- 
munication channel or service delivery pathway. For this analysis, 
we compared the impact of increasing coverage of combined 
interventions ("BF & PNC" and "ANC, SBA/FD, BF & PNC", 
called All-combined) at the same target coverage levels (10%, 30% 
and 50%, respectively). The bundling of key MNH interventions 
centered on data collection/registration and SMS reminder for 
scheduled visits (ANC), referral calling and emergency medical 
referral (SBA/FD), and healthy behavior promotion via text 
messages (BF & PNC). 

The final analysis was created to identify the optimal mix of 
services and tradeoffs in coverage by comparing four individual 
and two bundled interventions scenarios: 1) ANC, 2) SBA/FD, 3) 
BF, 4) PNC, 5) BF & PNC, and 6) All-combined. While 
vaccination is one of the key interventions in the MNH continuum 
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Figure 2. Neonatal Mortality Impacts by Various MNH Interventions and Coverage Scenarios in Bangladesh and Uganda in 2015. 

SOURCE: LiST. 

doi:1 0.1 371 /journal.pone.01 02224.g002 



of care, it was not included in these analyses due to the already 
high baseline coverage levels reported for both countries, 86% in 
Uganda and 95% in Bangladesh in 2011. 

Results 

Coverage values modeled for Bangladesh and Uganda for each 
selected intervention at target year 2015 are presented in Table 2. 
Modeled numbers of neonatal deaths averted in 2015 are 
presented in Table 3. Comparisons of the mortality impact of 



the four individual and two bundled interventions scenarios at all 
three coverage levels are presented by country in Figure 2. 

Comparing single interventions, SBA/FD provided the biggest 
mortality impact relative to other intervention scenarios with 
PNC, BF, and ANC, across both countries. For example, at 50% 
coverage target scenario, SBA/FD was estimated to save 7717 
neonates in Bangladesh and 7714 neonates in Uganda. Next, PNC 
was estimated as the second biggest mortality impact in 
Bangladesh with 1888 lives saved, while only 83 lives saved in 
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Uganda. In fact, PNG lead to fairly limited mortality reduction 
impact in Uganda because the baseline coverage was very low as 
only 2.8%, compared to 29.6% for Bangladesh. BF promotion also 
lead to fairly limited impact to both countries as 80 lives saved in 
Bangladesh with and 35 lives saved in Uganda. Examining the 
ANC scenario, the least mortality impact was estimated to both 
countries with 23 saved lives in Uganda and only 2 saved lives of 
neonates in Bangladesh. 

For the bundled interventions, All-combined interventions at 
50% coverage scenario demonstrated, not surprisingly, the largest 
impact in terms of neonatal mortality; the number of neonatal 
deaths averted was higher for Bangladesh with 9496 saved lives 
than 7839 in Uganda. Next, the bundled packages of BF & PNC 
(with 50% coverage scenario) produced considerable impact with 
1968 lives saved in Bangladesh, while only 1 1 8 lives saved in 
Uganda. The difference is mainly driven by the considerable 
mortality impact from PNC intervention in Bangladesh compared 
to Uganda. However, overall it is important to consider that initial 
baseline coverage of each intervention and mortality level differed 
by country. 

Discussion 

Given that SBA/FD emerged as the most effective intervention 
in terms of mortality impact in both countries, a possible 
recommendation based on this modeling experiment would be 
for a strategic focus on childbirth related interventions. Accord- 
ingly, this analysis supports the implementation of mHealth 
strategies such as facilitating emergency medical referrals for 
childbirth-associated interventions during intrapartum crises. The 
findings further highlight that despite a low baseline coverage of 
SBA/FD in Bangladesh in 2011-almost two times lower (31.7%) 
than (58%) in Uganda-Bangladesh demonstrates considerable 
potential to reduce neonatal mortality by focusing on SBA/FD 
interventions or combining SBA/FD with other interventions into 
bundled packages, at the 50% increased coverage level. Further, 
given the relatively greater mortality impact with bundled 
packages of BF & PNC in Bangladesh, one cross-cutting 
recommendation would be to use SMS text messaging to 
encourage health promotion and behavior change, leveraging 
the benefits of combined interventions, focusing on Information, 
Education, and Communication (IEC) strategies. With the ability 
to promote health service delivery, mHealth interventions may 
offer the opportunity to increase coverage more effectively and 
rapidly than standard methods. 

In this early application of LiST on modeling the potential 
impact of mHealth strategies, it is also important to note some 
similarities and distinctions between general assumptions of LiST 
based on standard healthcare delivery and the unique character- 
istics of mHealth strategies. In addition, careful consideration of 
major limitations and caveats in this approach is necessary to 
correctly interpret the mortality impact and suggest appropriate 
conclusions from the findings. 

First, the level of mortality impact is influenced by the reported 
initial baseline coverage level and evidence from standard care 
practices. [File S2] For example, the baseline PNC coverage is 
only 2.8% in Uganda and therefore the target coverage was set as 
4.2% in the case of a 50% coverage increase. Accordingly, the 
modeling resulted in a limited mortality reduction as well. In case 
of BF promotion (with 50% increase scenario), the LiST modeling 
algorithm assigned a mere 1-2% increase in BF prevalence of 
exclusive breastfeeding based on the embedded country specific 
evidence in Bangladesh and Uganda. mHealth interventions, 
however, could potentially enhance BF prevalence significantly 



through individualized, timely, and targeted interventions for 
behavior change, compared to a standard BF promotion 
intervention. On the other hand, in case of SBA/FD delivery 
(with 50% increase scenario), the coverage projection of CEmOC 
in Uganda is estimated as 86% by 2015, based on the baseline 
coverage as 51.7% in 2011. mHealth referrals alone, however, 
does not guarantee such a high coverage uptake without well- 
prepared and organized health systems including transportation 
access, medical commodities/equipment and skilled health pro- 
fessionals. 

Despite these caveats, this analysis adopted a relative target 
coverage approach, evenly distributed across each year, instead of 
setting an absolute target coverage number for 2015 or allowing 
for a fixed incremental coverage increase in each year through 
2015. As current mHealth studies have seldom presented 
information pertaining to targets set for coverage nor measured 
coverage over time precisely, it was challenging to base these 
growth projections on actual field-based performance. Yet, the 
relative target coverage modeling approach, using the existing 
modeling algorithms based on standard care practices, allows for a 
more consistent and conservative estimation across various 
interventions and combinations of interventions. Here, we 
assumed that the baseline coverage status reflects the level of the 
health system capacity in scaling up a given intervention and thus 
can be used to determine approximate target coverage for 2015. 

Second, like many other modeling tools, the analysis (and LiST) 
does not systematically consider health systems constraints in 
achieving the target coverage. Even for well-known effective 
interventions, the process of making real impact involves 
understanding the substantial constraints or obstacles within the 
broader context of the health systems. On one hand, mHealth 
strategies may leverage economies of scale and thus increase the 
coverage in some exponential fashion, as experience and efficiency 
with the system improve. On the other hand, they are more likely 
involve dis-economies of scale at the same time and increase 
marginal costs when the intervention faces a number of health 
systems constraints and challenges in remote areas or resource 
limited settings. For simplicity, our analyses assume linear trends 
over time, but acknowledge that complex health systems and 
bottlenecks in expanding programs are likely to lead to a non- 
linear adoption in intervention coverage. 

Accordingly, the analysis (and LiST) does not explain how the 
target coverage can be achieved. As noted, considering the 
multifaceted complexity and logistic challenges to scaling up 
health services, [62]. 

mHealth strategies, like any health system strengthening 
innovation, requires well-trained health care providers, sound 
supply chain management and stable technological platforms 
which are often critical challenges in many resource-limited 
settings. [63] As discussed earlier, while useful functions of 
mHealth are expected to overcome health systems gaps and 
obstacles, in reality, the success of well-functioning mHealth 
system is significantly dependent upon the level of capacity and 
readiness of the given health system. For instance, while our 
findings present the considerable impact on SBA/FD, if SBA/FD 
is significantly constraint by geographical inaccessibility or lack of 
skilled health professionals, then mHealth is likely to have limited 
impact. Alternatively, if SBA/FD is available, accessible and 
affordable but under-utilized, then mHealth may have a significant 
role in increasing the coverage. In this respect, some successful 
mHealth strategies may incorporate additional incentive mecha- 
nisms (ex. conditional cash transfer, voucher programs) or access 
mobilization strategies (ex. ambulance services) together to 
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promote care-seeking practice or facility delivery for pregnant 
women living in remote areas [34-36,64]. 

Third, this analysis does not consider effective coverage [65]- 
comprehensive sub-components of a given intervention package. 
While LiST allows the user to control coverage inputs for sub- 
components of some service interventions, this modeling did not 
incorporate specific performance scenarios of sub-components. 
For example, under ANC, there are several subcomponents such 
as tetanus toxoid vaccination (TT), intermittent preventive 
treatment of pregnant women for malaria (IPTp), calcium 
supplementation, multiple micronutrient supplementation, hyper- 
tension disease management, diabetes case management, malaria 
case management, and management of pre-eclampsia (MgS04). 
In this modeling study, we used a basic indicator of ANC-defined 
as "percent of pregnant women who go to 4 or more antenatal 
care visits during the pregnancy (ANC4+)"-with automatically 
calculated components based on standard assumptions from the 
current status of practice in the country. However, further 
mortality reductions would likely be observed if mHealth 
strategies, such as e-IMCI, delivering improvements in ANC 
coverage were also accompanied by improvements in the quality 
and comprehensiveness of the necessary sub-components of that 
service. In this respect, the LiST results provide a conservative 
estimate of the potential impact of mHealth strategies in this study. 
In other words, future studies may develop scenarios that illustrate 
how effective coverage-based models are expected to deliver 
differences in mortality reduction associated with an intervention, 
either crudely, or by accounting for specific sub-components of the 
intervention, as needed. 

Beyond modeling, prospective impact evaluation research 
would be useful to validate these models and provide more 
informed projections on potential coverage change associated with 
various mHealth solutions across different contexts over time. For 
instance, prospectively obtained data on coverage could also be 
manually added to a LiST model, allowing estimates of associated 
likely mortality reductions. Notably, this approach highlights the 
potential of coverage indicators to serve as the primary metrics of 
an evaluation strategy. Further, when possible, for even more 
precise estimations for a specific program, the program may also 
try to obtain available regional data on measures of health status 
(e.g. levels of risk factors and population exposures, baseline cause- 
specific mortality estimates etc.) to modify LiST modeling inputs. 
These indicators are often a less expensive (and time-consuming) 
endeavor to measure than the mortality endpoints of impact 
studies, yet can serve well for decision-makers seeking to 
understand the potential - or actual - health benefit of different 
investments into mHealth strategies. 

In summary, with a special focus on coverage as a primary 
measure of mHealth impact, LiST allows incorporation of two 
potentially advantageous aspects of mHealth: accelerated coverage 
"uptake" and improved coverage "quality". For example, in terms 
of the uptake, if an intervention (not limited to mHealth) protocol 
and sub-components are similar to the defined intervention 
criteria in the LiST, different coverage increase rate among 
various interventions can be used to compare the mortality impact. 
In terms of the quality, if an intervention promotes comprehen- 
siveness or compliance of service provision of an intervention 
package, users can control some available sub-components in the 
LiST to estimate the different mortality impact. In addition, when 
appropriate, programs may set certain target coverage based on 
relevant evidence from policy goals or resource constraints-instead 
of relative target scenarios based on baseline coverage-to estimate 
potential mortality impact. In this way, LiST can promote a 
greater allocative efficiency in a societal perspective, to evaluate 



performance of health service provision across various interven- 
tions, using coverage indicators. Further, this functional merit 
allows itself to be a benchmarking tool by examining different 
impact estimates across various types of intervention strategies or 
between estimated target impact and observed real impact. The 
gaps may allow researchers and implementers to infer potential 
bottlenecks in the given health system or discuss priority 
intervention strategies. 

Finally, while country-level impact estimation from LiST 
modeling scenarios may be extremely useful in setting priorities 
for mHealth (and even conventional public health) strategies, it is 
important to ensure that the findings serve as ingredients for 
informed discussion-making and not drive the selection of 
strategies in a vacuum. Although our findings suggest the most 
effective intervention to be SBA/FD coverage improvements, 
based on the mortality impact estimations, LiST does not account 
for the cost implications of increases in coverage or other health 
systems constraints. As noted, mHealth solutions often require 
additional funding and efforts to establish or connect to existing 
back-end health information systems, equip staff with mobile 
devices, conduct research to ensure effective deployment, advo- 
cacy activities to raise awareness about the program and 
improvements, and mechanisms to support and supervise health 
workers. [66] Moreover, various cultural, social, and political 
contextual factors mediate adoption and adaptation of new 
mHealth systems. Thus, decisions on where to focus resources 
and investments will have to be determined after taking into 
consideration the feasibilities of interventions and the existing 
health systems' strengths and limitations in any particular context. 

Conclusions 

This analysis explored an application of the LiST tool for 
planning and prioritization of mHealth strategies which could 
improve coverage in four key MNH intervention areas: ANC, 
SBA/FD, BF promotion, and PNC at three different target 
coverage level improvements-10%, 30%, and 50%. Models were 
run to estimate and compare the mortality impact of four key 
individual and two combined MNH interventions in the two 
countries examined, Bangladesh and Uganda. The model clearly 
identifies the potential expected benefits associated with some 
strategies and not others, while establishing possible 'aspirationaP 
targets for projects in these focal areas. In the context of 
Bangladesh and Uganda, the greatest benefits would likely be 
associated with mHealth strategies targeting MNH interventions 
at childbirth facilitating SBA/FD services. Moreover, Bangladesh 
would see the positive benefit through a bundled interventions 
approach leveraging a combination of BF promotion & PNC. 

Although further validation of this model is needed, this study 
represents to our knowledge, the first use of LiST as a strategy to 
identify, for innovators and governments, priority areas for 
mHealth strategic focus and investment. Our study may not only 
serve to improve the scope and quality of the assumptions in LiST, 
but also highlight areas where further research is needed on 
effectiveness of interventions. Many of the interventions, where 
insufficient data exist to estimate impact, are being used and/or 
promoted in countries. Clearly if better health policy decisions are 
to be made, additional efforts to collect data on the efficacy and 
effectiveness of these interventions need to be prioritized. 

We have described how the ZiSTtool would also allow existing 
projects in these domains to review their progress in terms of 
intervention coverage. This would enable projects to set bench- 
marks and monitor progress against projected targets, while 
providing information derived from rigorous, efficacy-trial driven 
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expectations. The importance of mHealth scale-up has been 
broadly emphasized in the mHealth community, but it is necessary 
to guide such scale up efforts and investment in ways that are most 
likely to achieve the mortality reduction targets set by national 
goals and global calls to action such as the MDGs, not merely to 
expand programs. The results of this analysis can contribute to 
discussions about how such plans can be formulated, emphasizing 
the likely highest-impact interventions for prioritization, consider- 
ing the unique potential for synergy across multiple areas that 
mHealth solutions typically allow. As the deadline for achieving 
the MDGs quickly approaches, use of available tools such as LIST 
can help us further leverage the benefit of mHealth by articulating 
the most appropriate delivery points in the continuum of care to 
save lives. 
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